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i.  TJ±  o»'**  * 

y}  In  this  paper  f  consider  the  issue  of  robust 
failure  detection.  In  one  way  or  another  all  failure 
detection  methods  (such  as  those  surveyed  in  [1.4!) 
generate  signals  which  tend  to  highlight  the  presence 
of  particular  failures  if  they  have  actually  occurred. 
However,  if  any  model  uncertainties  have  affects  on  the 
observables  which  are  at  all  like  those  of  one  or  more 
of  the  failure  modes,  these  will  also  be  accentuated. 
Consequently  the  problem  of  robust  failure  detection  is 
concerned  with  generating  signals  which  are  maximally 
sensitive  to  some  effects  (failures)  and  rlnimally 
sensitive  to  others  (model  errors)  .  _  _ _ _ 

The  initial  impetus  for  our  approach  to  this  pro¬ 
blem  came  from  the  work  reported  in  (S ,  13]  which  do¬ 
cument  the  first  and  to  date  by  far  most  successful 
application  and  flight  testing  of  a  failure  detection 
algorithm  based  on  advanced  methods  which  use  analytic 
redundancy .  Tha  singular  faature  of  that  project  was 
that  the  dynamics  of  tha  aircraft  wart  decomposed  in 
order  to  analyze  th«  relative  reliability  of  each 
individual  of  potentially  useful  failure  detaction  in¬ 
formation. 

In  [2]  we  presented  the  results  of  our  initial 
attempt  to  extract  tha  essenca  of  tha  method  used  in 
[9,  13}  in  order  to  develop  a  ganaral  approach  to  ro¬ 
bust  failura  detection.  As  discussed  in  that  reference 
and  in  others  (such  as  [3,  7*91).  all  failura  detection 
systems  arc  based  on  exploiting  analytical  redundancy 
relations  or  (generalized)  parity  checks.  These  are 
simply  functions  of  the  temporal  histories  of  the 
measured  quantities  which  have  the  property  that  they 
are  small  (ideally  zero)  whan  tha  system  is  operating 
normally.  In  [21  we  present  one  criterion  for  measur¬ 
ing  the  reliability  of  a  particular  redundancy  relation 
and  use  this  to  pose  an  optimization  problem  to  deter¬ 
mine  the  most  reliable  relation.  Tha  particular  mea¬ 
sure  chosen,  however,  leads  to  an  extremely  complex 
optimization  problem.  Moreover,  if  one  is  interested 
in  obtaining  a  list  of  redundancy  relations  in  order 
from  most  to  least  reliable,  one  must  essentially  solve 
a  separata  (and  progressively  more  complicated)  optimi¬ 
zation  problem  for  each  relation  in  the  list. 

In  this  paper  we  look  at  an  alternative  measure  of 
reliability  for  a  redundancy  relation.  Mot  only  does 
this  alternative  have  a  helpful  geometric  interpre¬ 
tation,  bue  it  also  leads  to  a  far  simpler  optimization 
procedure  involving  a  singular  value  decomposition. 

In  addition,  it  allows  us  in  a  natural  and  computa¬ 
tionally  feasible  way  to  consider  issues  such  as  scal¬ 
ing,  relative  merits  of  alternative  sensor  sets,  and 
explicit  tradeoffs  between  detectability  and  robustness. 


II. 


unmans 


In  thia  p.p.r  w«  focua  .tendon  on  llnaar.  on* 
drlvan,  UKnu-tiH  lyiti—  r  and  in  till*  Motion  wa 
conaidac  th»  nciaa-fraa  nodal 


n(k.l)  •  Aa(k) 


Kk) 


(1) 


Ttii.  nHuct  .**  .upportad  in  part  by  tha  offlia  of 
Naval  Kaaaaroh  uadar  Grant  N00014-77-C-0224  and  by 

NAM  An.a  and  NASA  Lanf lay  AaaaarcA  Cantara  undar 
Grant  SGL-22-0«-i34.  v 


DTICv^ 

SELECTE| 

MAY  9  1983 


3 


y  (k)  -  Cx(k) 


(2) 


whsrt  x  is  n-diasnsional ,  u  is  m-diaensional ,  y  is 
r-dimension&l,  and  A  and  B  are  perfectly  known.  A 
redundancy  relation  for  this  modal  is  some  linear  com¬ 
bination  of  present  and  lagged  values  of  y  which  should 
be  identically  zero  if  no  changes  (i.e.  failures)  occur 
in  (1),  (2).  As  discussed  in  [2,  3],  redundancy  re¬ 
lations  can  be  specified  mathematically  in  the 
following  way.  The  subspace  of  (p+l>  r-dim*nsional 
vectors  given  by 


C 

CA 

CA?J 


(3) 


is  called  the  space  of  parity  relations  of  order  s. 
Not#  that  if  o>  e  G,  then  the  parity  check 


r(k)  •  .»>' 


y(k) 

y(k+p> 


is  identically  zero. 

An  important  observation  for  the  approach  described 
in  the  sequel  is  that  G  is  the  orthogonal  complement  of 
tha  range  Z  of  the  matrix 


CA* 


(5) 


and  thus  a  complete  sat  of  independent  parity  relatione 
of  order  p  is  given  by  the  orthogonal  projection  of  the 
window  of  observations  y(k),  y (k+1) , . . . ,y (k+o)  onto  G. 

III.  An  Anoular  Measure  of  Robustness 

In  this  section  we  begin  by  focussing  on  a  noise- 
free  model  with  uncertain  parameters: 


x(k*l)  •  Mh)  x(k) 
y(k)  -  C(n)  x(k) 


(6) 


(7) 


where  n  is  a  vector  of  unknown  parameters  taking 
values  in  a  specified  set  K.  Referring  to  the  comment 
at  tha  end  of  the  preceding  section,  we  note  that  it 
is  i^osslble  to  find  parity  checks  which  are  perfect 
for  all  possible  values  of  K.  That  is,  in  ganeral  w% 
cannot  find  a  subspace  G  which  is  orthogonal  to 


2(n)  -  Range 


-  m) 


cm)  A(MP 


(8) 


for  all  n. 

Nhat  would  seem  to  make  sense  in  this  case  is  to 
choose  a  subspace  G  which  la  "as  orthogonal  as  oossiole” 
to  all  possibl#  Z (n ) .  Several  possible  ways  in  which 
this  can  be  done  are  described  in  detail  in  (3].  In 
this  psper  we  focua  on  the  one  approach  which  laads  to 
the  most  complete  picture  of  robust  redundancy  and 
which  is  computationally  the  simplest .  To  do  this, 
ws  must  maks  tha  assumption  that  K,  tha  s*»t 
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of  possible  values  of  r  is  finite.  Typically  what  this 
would  involve  is  choosing  representative  points  out  of 
the  actual,  continuous  range  of  parameter  values.  Here 
'’representative’*  means  spanning  the  range  of  possible 
values  and  having  density  variations  reflecting  any 
desired  weightings  on  the  likelihood  or  importance  of 
particular  sets  of  parameter  values.  However  this  is 
accomplished,  we  will  assume  for  the  remainder  of  this 
paper  that  n  takes  on  a  discrete  set  of  values  n-1,..., 
L.  and  will  use  the  notation  A^  for  A(n«i) ,  Z 1  for 
2(n»i),  ate. 

To  obtain  a  simple  computational  procedure  for 
determining  robust  redundancy  relations  we  first  com¬ 
pute  an  average  observation  subspace  2  which  is  as 
close  as  possibla  to  all  of  the  2^,  and  we  then  choose 
G  to  be  the  orthogonal  complement  of  2  .  To  be  more 
precise,  note  first  that  the  2.  are  subspaces  of 
possibly  differing  dimensions  (dim  2.  »  v^)  embedded 
in  a  space  of  dimension  N  -  (p+i) r  (corresponding  to 
histories  of  the  last  p+1  values  of  the  r -dimensional 
output)  .  Me  will  find  it  convenient  to  use  the  same 
symbols  2.,...,Z  to  denote  matrices  of  sizes  Nxs^, 
i-l,...,L,  whose  columns  form  orthonormal  bases  for 
the  corresponding  subspaces.  Letting  M  “  V,+. 
we  define  the  MxM  matrix 


!4oreover,  since  the  columns  of  V  are  orthonormal,  we 
immediately  see  that  the  orthogonal  con?) lament  of  the 
range  of  2q  is  given  by  the  first  s  left  singular 
vectors  of°Z..r  i.e.  the  first  s  columns  of  0.  Con¬ 
sequently  theycolumn»  of  the  matrix 


are  the  optimum  redundancy  relations. 

There  is  an  alternative  interpretation  of  this 
choice  of  G  which  provides  some  very  useful  Insight. 
Specifically,  recall  that  what  we  wish  to  do  is  to  find 
a  G  whose  columns  are  as  orthogonal  as  possible  to  the 
coluens  of  the  Z,j  that  is,  we  would  like  to  choose  G 
to  make  each  of  the  matrices  2*G  as  closa  to  zsro  as 
possible.  In  fact,  as  shown  in  [31,  the  choice  of  G 
given  in  (15)  minimizes 


Thus  the  columns  of  2  span  the  possible  directions  in 
which  observation  histories  may  lie  under  normal  con¬ 
ditions. 

We  now  suppose  that  we  wish  to  determine  the  s 
best  parity  checks  (so  that  dim  Os) .  Thus  we  wish  to 
determine  a  subspace  Z  of  dimension  M-s.  The  optimum 
choice  for  this  subspa Se  is  taken  to  be  the  span  of  the 
(not  necessarily  orthogonal)  columns  of  the  matrix  Zq 
which  minimizes 

II  z  -  zo  lip 

subject  to  the  constraint  that  rank  2  •  N-s.  Here 


di  ■'!  < 


yielding  the  minimus  value 


There  are  two  important  points  to  observe  about  the 
result  (16) ,  (17) .  The  first  is  that  ws  can  now  see  a 
straightforward  way  in  which  to  include  unequal  weight¬ 
ings  on  each  of  the  terms  in  (16).  Specifically,  if 
the  ere  positive  numbers,  then 


-i  zi 


Thus  ths  matrix  ZQ  is  chosen  so  that  the  sum  of  the 
squared  distances  between  the  colums  of  Z  and  of  ZQ 
have  only  N-s  linearly  independent  columns. 

There  are  several  important  reasons  for  choosing 
this  criterion,  one  being  that  it  doas  produce  a  space 
which  is  as  close  ae  possible  to  e  specified  set  of 
directions.  A  second  is  that  the  resulting  optimiza¬ 
tion  problem  is  easy  to  solve.  Zn  particular,  let  the 
singular  value  decomposition  of  Z  (14,  IS]  be  given  by 


where  0  and  V  are  orthogonal  matrices,  and 


*  0 

o  ’ 


Here  G.  <  5-  <  •  •  •  <.  GM  ere  the  singular  values  of  2 
ordered  by  magnitude.  Hots  we  have  assumed  M  <  n. 

If  this  is  not  the  case  we  can  make  it  so  without 
changing  the  optimum  choice  of  2  by  padding  2  with 
additional  columns  of  xsros.  It°is  readily  shown  that 
the  matrix  2  minimising  (10)  is  given  by 


so  that  minimizing  this  quantity  is  accos$lished  using 
the  same  procedure  described  previously  but  with  2. 
replaced  by  ^W£  Z*.  As  a  second  point  note  that  the 
optimum  value  (17)  provides  us  with  an  interpretation 
of  the  singular  values  as  measures  of  robustness  and 
with  an  ordered  sequence  of  parity  relatione  from  most 
to  least  robust:  u  is  the  most  reliable  parity  relation 
with  G*  as  its  measure  of  robustness,  u2  is  the  next 
best  relation  with  G^  *s  its  robustness  measure,  etc. 
Consequently  from  e  single  singular  value  decomposition 
we  can  obtain  a  comp  lata  solution  to  the  robust  redun¬ 
dancy  relation  problem  for  e  fixed  value  of  p,  i.e.  for 
a  fixed  length  time  history  of  output  values.  To  com¬ 
pere  relations  for  different  values  of  p  it  ie  necessary 
to  solve  e  singular  value  decomposition  for  each. 


In  this  section  we  address  several  of  the  draw¬ 
backs  end  limitations  of  the  result  of  the  preceding 
section  and  obtain  modifications  to  this  result  which 
ovareoae  chan  at  no  fundamental  increasa  in  complexity. 

4.1  Scaling 

A  critical  problem  with  criteria  of  tha  preceding 
section  is  that  all  vectors  in  the  observation  spaces 
2.  are  treated  as  being  equally  likely  to  occur.  If 
tnere  are  differences  in  scale  among  the  system  vari¬ 
ables  this  nay  lead  to  poor  solutions  for  the  optimum 
parity  relations.  To  overcome  this  drawback  we  proceed 


2 


as  follows.  Suppose  that  we  ir«  given  a  scaling  matrix  obtain  the  following  natural  generalization  of  the 
?  so  that  with  the  change  of  basis  criterion  (21): 


Z  -  ?x  (19) 

one  obtains  a  variable  ;  which  is  equally  likely  to 
lie  in  any  direction.  Such  a  matrix  could,  for 
example*  be  obtained  from  covariance  analysis* 

As  a  next  step,  recall  that  what  we  would  ideally 
like  to  do  is  to  choose  a  matrix  G  (whose  colrnns  re¬ 
present  the  desired  parity  relations)  so  that 


is  as  small  as  possible.  In  the  preceding  section  we 
considered  all  direction#  in  2  »  Range  CC^)  to  be  on 

equal  footing  and  arrived  at  the  criterion  (16) .  Since 
all  directions  for  Z  are  on  equal  footing,  we  are  led 
naturally  to  the  following  criterion  for  choosing  an 
SxS  matrix  G  which  takes  scaling  into  account 


The  solution  to  this  problsm  is  obtained  in  exactly 
the  same  way  as  in  the  previous  section:  We  perform 
a  singular  value  deccnpoeition  of  the  matrix 

c  *  (c1:c2:...:c2i  -  uzv  (22) 

where  C*  £  a2  ...  <_  ajj  and  0  •  Cu^.’Uj.*. ..  Then 

u2  is  the  best  parity  relation  with  o|  as  its  measure 
of  robustness ,  u2  is  the  next  beat ,  etc. ,  and  J* (s)  Is 
given  by  (17) .  Finally,  in  anticipation  of  the  next 
subsection,  suppose  that  we  use  the  stochastic  inter¬ 
pretation  of  ;,  i.e.  that 


ji,)  *  i*i  Ei t i 1 ; 2 1  (29) 

where  denotes  expectation  assuming  that  the  ith 
model  is  correct.  Assuming  that  5(k)  »  Px(k)  has  the 
Identity  as  its  covariance,  using  the  whiteness  of  w  and 
v,  and  oer forming  some  algebraic  manipulations  we  obtain 
£31 

J(s>  -  iijjlc/  a\\\  ♦  lis’oilj,  130) 

where  5  is  defined  by  the  following: 


Q  *  dlag  (Q, ... ,Q)  (p  times),  R  »  diag  (R,...,R) 

((p+l)  times)  (32) 

L 

»  ■  \  8  1SX  *  L*  -  SS'  (33) 


From  (30)  we  see  that  the  effect  of  the  noise  is 
to  specify  another  set  of  directions,  nemsly  the  columns 
of  S,  to  which  we  would  like  to  make  the  columns  of  G 
as  close  to  orthogonal  as  possible.  From  this  it  is 
evident  that  the  optimum  choice  of  G  is  computed  by 
performing  e  singular  value  decomposition  on  the  matrix 


1155*1  -  1 


(23)  tCx* -•  ••  CL*:  SI 
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In  this  case  if  we  define  the  perlty  check  vector 


•j. 

i 


(24) 


At  before  (64)  provides  a  complete  set  of  parity  rela¬ 
tions  ordered  in  term  of  their  degrees  of  insensitivity 
to  model  errors  and  noise. 


Then 


-  ;(c^0|I2P 

4.2  ObMmtlon  Mid  Proc.ii  Noi.lt 

Xn  addition  to  choosing  parity  relatione  which  are 
maximally  insensitive  to  model  uncertainties  it  ia 
also  important  to  choose  relations  which  suppress  noise 
Consider  then  the  model 

x(kel)  *  AjXtk)  ♦  OjW(k) 

(26) 

y(k)  •  CjX<k>  *  v(k) 

(27) 

where  w  end  v  are  independent,  zero-mean  white  noise 
processes  with  covariances  Q  and  ft,  respectively. 


Let 


4.3  Detection  versus  Robustness 

The  methods  described  to  this  point  involve  mea¬ 
suring  the  quality  of  redundancy  relations  in  terms  of 
how  smell  the  resulting  perlty  cheeks  ere  under  normal 
operating  conditions.  That  is,  good  parity  checks  are 
maximally  insensitive  to  modeling  errors  end  noise. 
However,  in  some  cases  one  might  prefer  to  use  Sh  al¬ 
ternative  viewpoint.  In  particular  there  may  be  parity 
checks  which  are  not  optimally  robust  in  the  senses  we 
have  discussed  but  are  still  of  significant  value  be¬ 
cause  they  are  extremely  sensitive  to  particular  failure 
modes.  Xn  this  subsection  we  consider  a  criterion  which 
takes  such  e  possibility  into  account.  For  simplicity 
we  focus  on  the  noise-free  case.  The  extension  to  In¬ 
clude  noise  as  in  the  previous  subsection  is  straight¬ 
forward. 

The  specific  problem  we  consider  is  the  choiee  of 
parity  checks  for  the  robust  detection  of  a  particular 
failure  mode,  me  assume  that  the  \si failed  model  of  the 

system  is 


Then  using  the  interpretation  provided  in  (25),  we 
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x(k+l)  -  Au(n)  x(k) 
y(k)  •  C  (ri)  x(k) 


(35) 

(36) 


while  if  the  failure  ha*  occurred  tha  modal  is 


x(k+l)  »  ApW)  x(k>  (37) 

•/( k)  -  CF(n)  x(k)  (38) 

In  this  casa  ona  would  like  to  choosa  Q  to  ba  "as 
orthogonal  as  possible"  to  Z^(n)  and  "as  parallal  as 
possibla"  to  2^(n). 

Assume  again  that  h  takas  on  ona  of  a  ffinita  sat 
of  possibla  values,  and  1st  C  and  C#i  danota  tha 
counterparts  of  C.  in  (20)  for  tha  uncalled  and  failad 
sodals.  raspactivily.  A  natural  critarion  which  re- 
flacts  our  objactiva  is 


J(S)  -  mtn  Z  HIc  ;  sill  -  i|c  •  s|i*)  (39) 

g'G-i  x*i  ui  r  Pi  f 
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where  U*U  ■  I  and 


A  •  di«9  . XR) 


with  \.  <  A,  <  •••  £  X  and  U  ■  fu.  Then  the 

optima  choice  of  G  is 


G  *  [u^:* •• tu^l 


and  the  corresponding  value  of  (73)  Is 


J*(s)  -  LZ  (46) 

Note  that  in  genaral  some  of  the  X  are  negative.  In 
fact  the  parity  cheek  baaed  on  u^  Is  likely  to  have 
larger  values  under  failed  then  failed  conditions  only 
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